HIGHER RANK BRILL-NOETHER THEORY ON SECTIONS OF K3 SURFACES 
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ABSTRACT. We discuss the role of K3 surfaces in the context of Mercat's conjecture in 
higher rank Brill-Noether theory. Using liftings of Koszul classes, we show that Mercat's 
conjecture in rank 2 fails for any number of sections and for any gonality stratum along 
a Noether-Lefschetz divisor inside the locus of curves lying on K3 surfaces. Then we 
show that Mercat's conjecture in rank 3 fails even for curves lying on K3 surfaces with 
Picard number 1. Finally, we provide a detailed proof of Mercat's conjecture in rank 2 
for general curves of genus 11, and describe explicitly the action of the Fourier-Mukai 
involution on the moduli space of curves. 



1. Introduction 

The Clifford index Cliff (C) of an algebraic curve C is the second most important 
invariant of C after the genus, measuring the complexity of the curve in its moduli 
space. Its geometric significance is amply illustrated for instance in the statement 

K p>2 {C,K c ) = 0^p< Cliff (C) 

of Green's Conjecture |G| on syzygies of canonical curves. It has been a long-standing 
problem to find an adequate generalization of Cliff (C) for higher rank vector bundles. 
A definition in this sense has been proposed by Lange and Newstead |LN1|: If E G 
Uc(n, d) denotes a semistable vector bundle of rank n and degree d on a curve C of 
genus g, one defines its Clifford index as 

7 (E) := n{E) - -h°(C, E) + 2>0, 
n 

and then the higher Clifford indices of C are defined as the quantities 

CM n {C) :=mm{j(E) : E eU c (n,d), d<n{g-l), h°(C, E) > 2n}Q. 

Note that Cliff X (C) = Cliff (C) is the classical Clifford index of C. By specializing to 
sums of line bundles, it is easy to check that Cliff n (C) < Cliff(C) for all n > 1. Mercat 
|Me] proposed the following interesting conjecture, which we state in the form of BLNlfl 
Conjecture 9.3, linking the newly-defined invariants Cliff n (C) to the classical geometry 
ofC: 

(M n ) : Cliff* (C) = Cliff (C). 
Mercat's conjecture (M2) holds for various classes of curves, in particular general k- 
gonal curves of genus g > 4k — 4, or arbitrary smooth plane curves, see |LN1]. In 
|FOfl Theorem 1.7, we have verified (M2) for a general curve [C] € M. g with g < 16. 
More generally, the statement (M2) is a consequence of the Maximal Rank Conjecture 
(see [FOJ Conjecture 2.2), therefore it is expected to be true for a general curve [C] G 



^The invariant Cliff n (C) is denoted in the paper | LN1 1 by j' n (C) . Since the appearance of I LN1I , it has 
become abundantly clear that Cliff n (C), defined as above, is the most relevant Clifford type invariant for 
rank n vector bundles on C. Accordingly, the notation Cliff n {C) seems appropriate. 
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M g . However, for every genus g > 11 there exist curves [C] G M g with maximal 
Clifford index Cliff (C) = carrying stable rank 2 vector bundle s E with h°(C, E) = 
4 and j(E) < Cliff (C), see |FO) Theorems 3.6 and 3.7 and I1LN21 Theorem 1.1 for an 
improvement. For these curves, the inequality Cliff 2(C) < Cliff (C) holds. 

Obvious questions emerging from this discussion are whether such results are 
specific to (i) rank 2 bundles with 4 sections, or to (ii) curves with maximal Clifford 
index First we prove that under general circumstances, curves on K3 surfaces 

carry rank 2 vector bundles E with a prescribed (and exceptionally high) number of 
sections invalidating Mercat's inequality 7 (E) > Cliff (C): 

Theorem 1.1. We fix integers p > 1 and a > 2p + 3. There exists a smooth curve C of 
genus 2a + 1 and Clifford index Cliff (C) = a, lying on a K3 surface C C S C P 2p+2 with 
Pic(S) = Z-C ®Z- H, where H 2 = Ap + 2, H -C = deg(C) = 2a + 2p + 1, as we// as a 
sfafoZe ranfc 2 sector bundle E G SUc(2, Oc(H)), such that h°(C, E) = p + 3. In particular 
j(E) = a — \ < Cliff (C) and Mercat's conjecture (M 2 ) fails for C. 

It is well-known cf. MM2L IVT1 , that a curve [C] e M 2a +i lying on a K3 surface S 
possesses a rank 2 vector bundle F € SUc(2, Kc) with n°(C, F) = a + 2. In particular, 
7(F) = a > Cliff(C) (with equality if Pic(S') = Z • C), hence such bundles satisfy 
condition (M2). Let us consider the K3 locus in the moduli space of curves 

Kg := {[C] G Ai g : C lies on a K3 surface}. 

When g = 11 or g > 13, the variety /C 9 is irreducible and dim(/C 9 ) = 19 + g, see [CLMj 
Theorem 5. For integers r, d > 1 such that d 2 > 4(r — l)g and 2r — 2 { d, we define the 
Noether-Lefschetz divisor inside the locus of sections of K3 surfaces 

C lies on a K3 surface S, Pic(S) D Z • C Z • H, 
H € Pic(5) is nef, H 2 = 2r - 2, C ■ H = d, C 2 = 2g - 2 

A consequence of Theorem 1 1 . 1 1 can be formulated as follows: 

Corollary 1.2. We fix integers p > 1 and a > 2p + 3 and set g := 2a + 1. Then Mercat's 
conjecture (M2) fails generically along the Noether-Lefschetz locus ^£? g P 2a+2p+i inside K, g , that 
is, Cliff 2 (C) < Cliff(C) for a general point [C] e ^f^p+i- 

It is natural to wonder whether it is necessary to pass to a Noether-Lefschetz 
divisor in JC g , or perhaps, all curves [C] G JC g give counterexamples to conjecture (M2). 
To see that this is not always the case and all conditions in Theorem 11.11 are necessary, 
we study in detail the case g = 11. Mukai |M3B proved that a general curve [C] G Mn 
lies on a unique K3 surface S with Pic(S) = Z • C, thus, Mn = K\\. 

Theorem 1.3. For a general curve [C] G Mn one has the equality Cliff2(C) = Cliff (C), that 
is, Mercat's conjecture holds generically on M\\. Furthermore, the locus 

{[C] G Mn : Cliff 2 (C) < Cliff(C)} 

can be identified with the Noether-Lefschetz divisor 9X2^ 13 on Mn- 

In Section 5, we describe in detail the divisor 9T£f x 13 and discuss, in connection 
with Mercat's conjecture, the action of the Fourier-Mukai involution FM : T\\ — > T\\ 
on the moduli space of polarized K3 surfaces of genus 11. The automorphism FM acts 
on the set of Noether-Lefschetz divisors and in particular it (i) fixes the 6-gonal locus 
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M.\i 6 and it maps the divisor 9t£ii 13 which corresponds to certain elliptic K3 surfaces, 
to the Noether-Lefschetz divisor corresponding to K3 surfaces carrying a rational curve 
of degree 3. 

Next we turn our attention to the conjecture (M n ) for n > 3. It was observed in 
[LMNJ that Mukai's description [M4J of a general curve of genus 9 in terms of linear 
sections of a certain rational homogeneous variety, and especially the connection to 
rank 3 Brill-Noether theory, can be used to construct, on a general curve [C] € Mg, a 
stable vector bundle E £ SU C (3,K C ) such that h°(C,E) = 6. In particular j(E) = 
™ < Cliff (C), that is, Mercat's conjecture (M 3 ) fails for a general curve [C] G Mg. A 
similar construction is provided in [LMN] for a general curve of genus 11. In what 
follows we outline a construction illustrating that the results from [LMN| are part of a 
larger picture and curves on K3 surfaces carry vector bundles E of rank at least 3 with 
j(E) < Cliff(C). 

Let S be a K3 surface and C C S a smooth curve of genus g. We choose a linear 
series A G WUC) of minimal degree such that the Brill-Noether number p{g,r,d) is 

non-negative, that is, d := r + [ r *!+{ ]■ The Lazarsfeld bundle Ma on C is defined as the 
kernel of the evaluation map, that is, 

— > Ma — > H°(C, A) (g) Oc A — > 0. 

As usual, we set Qa '■= M y A , hence rank(Q^) = r and det(QA) = A. Following a 
procedure that already appeared in (Jj, IM2L II VI II , we note that C carries a vector 
bundle of rank r+1 with canonical determinant and unexpectedly many global sections: 

Theorem 1.4. For a curve C C S and A € W^(C) as above there exists a globally generated 
vector bundle E onC with rank(E') = r + 1 and det(E) = Kc, expressible as an extension 

— > Qa — ► E — > K c A v — > 0, 

satisfying the condition h (C,E) = h Q {C 1 A) + h Q {C,Kc®A y )=g-d + 2r + l. If moreover 
r < 2 and Pic(S') = Z • C, then the above extension is non-trivial. 

When r = 1 the rank 2 bundle E constructed in Theorem [L4] is well-known and 
plays an essential role in [V1J. In this case j(E) > [^p]. For r = 2 and g = 9 (in which 
case A € W|(C)), or for g = 11 (and then A e Wl Q (C)), Theorem 11.41 specializes to 
the construction in [LMN]. When rank(£^) = 3, we observe by direct calculation that 
'y(E) < [^2~]. In view of providing counterexamples to Mercat's conjecture (M3), it is 
thus important to determine whether E is stable. 

Theorem 1.5. Fix C C S as above with g = 7, 9 or g > 11 such that Pic(S) = Z • C, as well 
as A g W$(C), where d := [-^]. Then any globally generated rank 3 vector bundle E on C 
lying non-trivially in the extension 

— > Qa — > E — > Kc A v — ► 0, 

and with h°{C, E) = h°(C, A) + h°(C, Kc <8> A v ) = g — d + 5, is stable. 

As a corollary, we note that for sufficiently high genus Mercat's statement (M3) 
fails to hold for any smooth curve of maximal Clifford index lying on a K3 surface. 

Corollary 1.6. We fix an integer g = 9 or g > 11 and a curve [C] € K g . Then the inequality 
Cliff 3(C) < holds. In particular, Mercat's conjecture (M 3 ) fails generically along K g . 
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We close the Introduction by thanking Herbert Lange and Peter Newstead for 
making a number of very pertinent comments on the first version of this paper. 

2. Higher rank vector bundles with canonical determinant 

In this section we treat Mercat's conjecture (M 3 ) and prove Theorems 11.41 and 
11.51 We begin with a curve C of genus g lying on a smooth K3 surface S such that 
Pic(5) = Z • C, and fix a linear series A G Wj{C) of minimal degree d := [^]. Under 
such assumptions both A and Kc ® A v are base point free. From the onset, we point 
out that the existence of vector bundles of higher rank on C having exceptional Brill- 
Noether behaviour has been repeatedly used in [L|, |M2J and (VT). Our aim is to study 
these bundles from the point of view of Mercat's conjecture and discuss their stability. 

We define the Lazarsfeld-Mukai sheaf Fa via the following exact sequence on S: 



F A ^H°(C,A) 



O s ^A 



0. 



Since A is base point free, Fa is locally free. We consider the vector bundle E A '■= ^a 
on S, which by dualizing, sits in an exact sequence 

H°(C,A) V 







O s ^£a 



K C ®A X 



0. 



(1) 

Since Kc <S> A v is assumed to be base point free, the bundle £a is globally generated. It 
is well-known (and follows from the sequence CD, that c\{£a) = Os(C) and C2{£a) = d. 
Proof of Theorem UT4l We write down the following commutative diagram 










H°(C,A)®O s (-C) 
Ta 
M a 







H°(C,A)®O s (-C) 



H°(C,A)®G S 



H°(C,A)®O c 



A 



A 



Oc and Ea := £ a ® Oc, we obtain the exact sequence 

> H°(C,A) ®K%^F A ^M A ^0 

i Kq). Taking duals, we find the exact sequence 





from which, if we set Fa ■= Fa 

— > Ma <S> Kq - 
(use that Tor^ s (M A , O c ) = M A 
(2) — ► Q A —> E A — > K c ® A y — > 0. 

Since 5 is regular, from Q we obtain that £a) = h°(C, A) + h°(C, K c ® ^ v ) while 
® Os(-C)) = 0, that is, 

h°(S, £ A ) < h°(C, E A ) < h°(C, A) + h°(C, K c ® A v ). 

Thus the sequence (O is exact on global sections. 

We are left with proving that the extension |(2} is non-trivial. We set r = 2 and 
then rank(£' J 4) = 3 and place ourselves in the situation when Pic(5) = Z • C (the case 
r = 1 works similarly). By contradiction we assume that Ea = Qa © (Kc <8> ^4 V ) and 
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denote by s : Ea — > Qa a retract and by s : £a — > Qa the induced map. We set 

M := Kerj^A — > Qa}, hence M. can be regarded as an elementary transformation of 
the Lazarsfeld-Mukai bundle 8 a along C. By direct calculation we find that 

d(M) = O s {-C) and c 2 (M) = 2d-2g + 2, 

hence the discriminant of M equals A(M) := 6c 2 (M) - 2c? (M) = 4(3d - Ag + 4) < 0. 
Thus the sheaf M is Os(C) -unstable. Applying [HLJ Theorems 7.3.3 and 7.3.4, there 
exists a subsheaf M' C M such that if £ MM , := - t^^j G Pic(,S) K , then 

(*) £m,M' • C > and («) ^ ~^Y^- 

Since Pic(5) = Z • C, we may write ci(AI') = O s (aC) and also set r' := rank(A4')- The 
Lazarsfeld-Mukai bundle 8a is Og (C^-stable, in particular nc(-M') < hc{£a)> which 
yields a < 0. Then from (i) we write that < 4 + g < |/ whereas from (u) one finds 

1 4( 5 -1)- 3d 

which is a contradiction. It follows that the extension 10 is non-trivial. □ 

It is natural to ask when is the above constructed bundle Ea stable. We give an 
affirmative answer under certain generality assumptions, when r < 3. 

We fix a A"3 surface 5 such that Pic(S) = Z • C and as before, set d := [^]. Under 
these assumptions, it follows from [LJ that C satisfies the Brill-Noether theorem. We 
prove the stability of every globally generated non-split bundle E sitting in an extension 
of the form ((2]) and having a maximal number of sections. 

Proof of Theorem [L5l We first discuss the possibility of a destabilizing sequence 

— > F — ► E — > B — ► 0, 

where F is a vector bundle of rank 2 and deg(F) > |(g — 1). Since E is globally gen- 
erated, it follows that B is globally generated as well, hence h°(C, B)>2,m particular 
deg(B) > (g + 2)/2 and hence deg(F) < \g - 3. Since deg( J B) < §( 5 - 1) and C is 
Brill-Noether general, it follows that h°(C, B) = 2, therefore h°(C, F) > g - d+ 3. There 
are two cases to distinguish, depending on whether F possesses a subpencil or not. 

Assume first that F has no subpencils. We apply [PRJ Lemma 3.9 to find that 
h°(C, det(F)) > 2h°(C, F) - 3 > 2g - 2d + 3. Writing down the inequality 

p(g,2g-2d + 2,deg(F)) >0 

and using that deg(F) < |g — 3, we obtain a contradiction. If on the other hand, F has 
a subpencil, then as pointed out in |FO[ Lemma 3.2, j(F) > Cliff (C), but again this is a 
contradiction. This shows that E cannot have a rank 2 destabilizing subsheaf. 
We are left with the possibility of a destabilizing short exact sequence 

— > B — > E — > F — ► 0, 

where B is a line bundle with deg(-B) > |(<? — 1) and F is a rank 2 bundle. The bundle 
Qa is well-known to be stable and based on slope considerations, B cannot be a sub- 
bundle of Qa, that is, necessarily H°(C, K c ® A v ® B v ) ^ 0. Since the bundle E is not 
decomposable, it follows that deg(-B) < deg(A"c* ® A v ) — 1 = 2g — 3 — d. Furthermore 

ti l (C,B)>3. 
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If F is not stable, we reason along the lines of [LMNj Proposition 3.5 and pull- 
back a destabilizing line subbundle of F to obtain a rank 2 subbundle F' C E such 
that 

deg(F') > deg(F) + ^(deg(F) - deg(F)) > ^(g - 1), 

which is the case which we have already ruled out. So we may assume that F is stable. 
We write h°(C,B) = a + 1, hence h°(C,F) > g-d-a + 4. Assume first that F admits no 
subpencils. Then from |PR] Lemma 3.9 we find the following estimate for the number 
of sections of the line bundle det(F) = Kq ® F v , 

h°(C, K c <8> F v ) > 2h°(C, F) - 3 > 2g - 2d - 2a + 5, 

which, after applying Riemann-Roch to B, leads to the inequality 

3a> 5 -2d + 5 + deg(F). 

Combining this estimate with the Brill-Noether inequality p(g, a, deg(F)) > and 
substituting the actual value of d, we find that 3a + 3 > g. On the other hand a < 
h°(C, K c <S> A v ) - 2 = g - d < and this is a contradiction. 

Finally, if F admits a subpencil, then 7(F) > Cliff (C). Combining this with the 
classical Clifford inequality for B, we find that 7(F) > Cliff (C), which again is a con- 
tradiction. We conclude that the rank 3 bundle F must be stable. □ 

3. Rank 2 bundles and Koszul classes 

The aim of this section is to prove Theorem ll.il We shall construct rank 2 vector 
bundles on curves using a connection between vector bundles on curves and Koszul 
cohomology of line bundles, cf. |AN] and HV2|| . Let us recall that for a smooth pro- 
jective variety X, a sheaf T and a globally generated line bundle L on X, the Koszul 
cohomology group K PyQ (X; F, L) is defined as the cohomology of the complex: 

P /\ H^L)®!!^?®^- 1 ) dp ^T 1 f\H (L)®H°(F®LO)H P /\ F°(L)®F°(F®F'+ 1 ). 

Most of the time F = O x , and then one writes K Piq (X; O x ,L) := K Piq (X, L). 

A Koszul class [(] G K p ,i(X, L) is said to have rank < n, if there exists a subspace 
W C H°(X,L) with dim(W) = n and a representative ( G A?W <g) H°(X,L). The 
smallest number n with this property is the rank of the syzygy [Q . 

Next we discuss a connection due to Voisin [V2J and expanded in (AN|, between 
rank 2 vector bundles on curves and syzygies. Let F be a rank 2 bundle on a smooth 
curve C with h°(C, E) > p + 3 > 4 and set L := det(F). Let 

A : A 2 H°(C,E) -> H°(C,L) 

be the determinant map, and we assume that there exists linearly independent sections 
ei G H°(C, E) and e 2 , . . . , e p+3 G H°(C, F), such that the map 

A(ei A -) : (e 2 ,...,e p+3 ) ^H°(C,L) 

in injective onto its image. Such an assumption is automatically satisfied for instance if 
F admits no subpencils. We introduce the subspace 

W := (s 2 := A(ei A e 2 ), . . . , s p+3 := A(ei A e p+3 )> C H°(C, L). 
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By assumption, dim (TV) = p + 2. Following |ANj and )|V2| , we define the tensor 

((E) := ^2{-l) i+j s 2 A ... A Si A ... A Sj A ... A s p+3 ® A(e* A ej) G A P W ® F°(C, L). 

i<j 

One checks that d P: i(((E)) = 0, hence [C(-E)] € K P ^(C,L) is a non-trivial Koszul class 
of rank at most p + 2. Conversely, starting with a non-trivial class [(] € K Pt i(C,L) 
represented by an element ( of A P VF (g> H°(C, L) where dim(W) = p + 2, Aprodu and 
Nagel [AN] Theorem 3.4 constructed a rank 2 vector bundle E on C with det(i^) = L, 
/i°(C, -E 1 ) > p + 3 and such that [C (-£?)] = [£]. This correspondence sets up a dictionary 
between the Brill-Noether loci in {E G SU C (2, L) : k°(C, E)>p + 3} and Koszul classes 
of rank at most p + 2 in K P: i(C, L) . 

Let us now fix integers p > 1 and a > 2p + 3. Using the surjectivity of the period 
mapping, see e.g. [KJ Theorem 1.1, one can construct a smooth A'3 surface S C P 2p+2 of 
degree Ap + 2 containing a smooth curve C C S* of degree d := 2a + 2p + 1 and genus 
g := 2a + 1. The surface 5 can be chosen with Pic(S) = Z-H®Z-C, where # 2 = 4p + 2, 
H ■ C = d and C 2 = 4a. The smooth curve C Cis the hyperplane section of S and 
has genus g(H) = 2p + 2. The following observation is trivial: 

Lemma 3.1. Keeping the notation above, we have that H°(S, Os(H — C)) = 0. 

Proof. It is enough to notice that H is nef and (H - C) ■ H = 2p — 2a + 1 < 0. □ 

We consider the decomposable rank 2 bundle Kjj = A(B {Kjj <g> ^4 V ) on H, where 
A € Wp +2 {H). Via the Green-Lazarsfeld non-vanishing theorem fGLlll (or equivalently, 
applying |ANJ), one obtains a non-zero Koszul class of rank p + 1 

/?:= [C(4®(^®A V ))J eK p>1 (H,K H ). 
Since 5 is a regular surface, there exist an exact sequence 

— > i7°(S, O s ) — > i7°(S, Os(fT)) — > H°(H, K H ) — > 0, 
which induces an isomorphism [G) Theorem (3.b.7) 

resH : JC p ,i(S, O s (fT)) * K p>1 (H,K H ). 

By construction, the non-trivial class a := res^ 1 (/3) <G K Pj i(S, Os(H)) has rank at most 
rank(/3) + 1 = p + 2. Using (G) Theorem (3.b.l), we write the following exact sequence 
in Koszul cohomology: 

...-»• (S; -C,H)^ K p>1 (S, H) -+ K Pjl (C, H ® O c ) ^-i, 2 (5; -C, H) -> • ■ ■ . 

Since £T°(5, 0s(# - C)) = 0, it follows that #p,i(S; -C, £T) = 0, in particular the non- 
zero class a G H) can be viewed as a Koszul class of rank at most p + 2 inside 
the group K Pt i(C, Oc{H)). This class corresponds to a stable rank 2 bundle on C: 

Proposition 3.2. Let C C S C P 2p+2 as above and L := O c (l) G Pic 2a+2p+1 (C). Then there 
exists a stable vector bundle E G SUc(2, L) with h°(C, E) = p + 3. 

Proof. From [AN] we know that there exists a rank 2 vector bundle E onC with det(-E') = 
L such that [((E)] = a G K p>1 (C, L), in particular h°(C, E) > p + 3. Geometrically, E is 
the restriction to C of the Lazarsfeld-Mukai bundle £a on S corresponding to a pencil 
A G Wp +2 (-ff). In particular, £J is globally generated, being the restriction of a globally 
generated bundle on S. We also know that Cliff (C) = a (to be proved in Proposition 
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133b . Since r y{E)<a-\< Cliff (C), it follows that E admits no subpencils (If B C E is 
a subpencil, then h°(C, L cgs i? v ) > 2 because is globally generated. It is easily veri- 
fied that both B and L ® f? v contribute to Cliff (C), which brings about a contradiction). 
Assume now that 

— > B — > E — > L®B V — >0 

is a destabilizing sequence, where B e Pic(C) has degree at least a + p + 1. As already 
pointed out, h°(C,B) < 1, hence h Q (C,L® B v ) > p + 2. If ^(C,L ® 5 V ) < 1, then 
p + 2 < h°(C, L <S> B v ) < 1 + deg(L ®B y )- 2a, which leads to a contradiction. If on the 
other hand h x {C, L ® B y ) > 2, then Cliff (L ® 5 V ) <a-p-2<a, which is impossible. 
Thus E 1 is a stable vector bundle. □ 

We are left with showing that the curve C C S constructed above has maximal 
Clifford index a. Note that the corresponding statement when p = 1 has been proved 
in HQ) Theorem 3.6. 

Proposition 3.3. We fix integers p > 1, a > 2p + 3 and a K3 surface S with Picard lattice 
Pic(S) = Z ■ H ®Z ■ C where C 2 = 4a, H 2 = Ap + 2 and C ■ H = 2a + 2p + 1. T/zen 
Cliff (C) = a. 

Proof. First note that C has Clifford dimension 1, for curves C C S of higher Clifford di- 
mension have even genus. Observe also that h°(C, Oc{l)) = 2p + 3and h l (C, Oc(l)) = 
2, hence Oc(l) contributes to the Clifford index of C and 

Cliff(C) < Cliff(C, 0(1)) = C H- 2(2p + 2) = 2a - 2p - 3 (> a) . 

Assume by contradiction that Cliff (C) < a. According to [GL2J, there exists an effective 
divisor D = mH + nC on S satisfying the conditions 

(3) h°(S, O s (D)) > 2, h°(S, O s (C - D)) > 2, C ■ D < g - 1, 

and with Cliff (O c (D)) = Cliff (C). By |HD Lemma 2.2, the dimension h°(C, O c >(D)) 
stays constant for all smooth curves C G \C\ and its value equals h°(S,D). We con- 
clude that Cliff (C) = Cliff (O c (D)) = D ■ C - 2 dim \D\. We summarize the numerical 
consequences of the inequalities (01: 

(i) md + 2n(g - 1) < g - 1 
(ii) (2p + l)m 2 -I- mnd + n 2 (g — 1) > 
(iii) (Ap + 2)m + dn > 2, 

We claim that for any divisor D C S verifying (i)-(iii), the following inequality holds: 

Cliff(e>c(£>)) = D-C-D 2 -2>H-C-H 2 -2 = 2a-2p-3>a. 

This will contradict the assumption Cliff (C) < a. The proof proceeds along the lines of 
Theorem 3 in [Fj, with the difference that we must also consider curves with D 2 = 0, 
that is, elliptic pencils which we now characterize. By direct calculation, we note that 
there are no (— 2)-curves in S. Equality holds in (ii) when m = —n or m = —un with 

u := 2a/(2p + 1). 

First, we describe the effective divisors D c S with self-intersection D 2 = 0. Consider 
the case m = —un. If 2p + 1 does not divide a, then D = 2aH — (2p + 1)C and D ■ C = 
2a(2a — 2p — 1) > g — 1, that is, D does not verify condition (i). If a = k(2p + 1), for 
k > 2, then D = 2kH - C. Notice that D ■ C = a(4k - 4) + 2k(2p + 1) > 2a for k > 2, 
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that is, D does not satisfies (i). 

In the the case m = —n, the effective divisor D = C — H , satisfies (i)-(iii) and 

Cliff (O c {C - H)) = 2a - 2p - 3 > a. 

Case n < 0. From (ii) we have either m < —n or m > —un. In the first case, 
by using inequality (Hi), we obtain 2 < — (Ap + 2)n + dn = n(2a — 2p - 1), which is 
a contradiction since n < and 2a > 2p + 1. Suppose m > — un > 0. Inequality (i) 
implies that 

( " n) 2^TT < " (5 " 1)(2n " 1} = " 2a(2n " 1} ' 

then (-n) (d - (4p + 2)) < 2p + 1 and since d > 4p + 2, this yields 2a + 2p + 1 = d < 6p + 3 
which contradicts the hypothesis a > 2p + 3. 

Case n > . Again, by condition (ii), we have either that m < —un orm> —n. In 
the first case, using (Hi) we write that 

< (Ap + 2)m + dn < n ( d - (Ap + 2) 



2p+l 

but one can get easily check that d(2p + 1) < 2a(Ap + 2), which yields a contradic- 
tion. Suppose now — n < m < 0. By (i) we have 2a(2n — 1) < —md < nd, so 
n < ia^d = 2a- 2 2p-i < ^' s i nce a ^ 2p + 1, This implies n = 1, therefore for n > 
there are no divisors D C S with D 2 > satisfying the inequalities (i)-(iii). 

Case n = 0. From (i), one writes m < = 2a +2p+i < ^' ^ ut tn ^ s yields to a 
contradiction since by (Hi) it follows that m > 0. The proof is thus finished. 

□ 



4. Curves with prescribed gonality and small rank 2 Clifford index 

The equality Cliff 2(C) = Cliff (C) is known to be valid for arbitrary fc-gonal curves 
[C] € k of genus g > (k — l)(2k — 4). It is thus of some interest to study Mercat's 
question for arbitrary curves in a given gonality stratum in M g and decide how sharp is 
this quadratic bound. We shall construct curves C of unbounded genus and relatively 
small gonality, carrying a stable rank 2 vector bundle E with h (C, E) = 4 such that 
'y(E) < Cliff (C). In order to be able to determine the gonality of C, we realize it as 
a section of a K3 surface S in P 4 which is special in the sense of Noether-Lefschetz 
theory. The pencil computing the gonality is the restriction of an elliptic pencil on the 
surface. The constraint of having a Picard lattice of rank 2 containing, apart from the 
hyperplane class, both an elliptic pencil and a curve C of prescribed genus, implies that 
the discriminant of Pic(S) must be a perfect square. This imposes severe restrictions on 
the genera for which such a construction could work. 

Theorem 4.1. We fix integers a > 3 and b = 4, 5, 6. There exists a smooth curve C CP 4 with 

deg(C) = 6a + b, g(C) = 3a 2 + ab + 1 and gonality gon(C) = ab, 

such that C lies on a (2, 3) complete intersection K3 surface. In particular Ki t \ (C, Oc(l)) ^ 
and conjecture (M 2 ) fails for C. 



10 



G. FARKAS AND A. ORTEGA 



Before presenting the proof, we discuss the connection between Theorem l4.1l and 
conjecture (M2). For C C S C P 4 as above, we construct a vector bundle E with 
det(-E) = Oc(l) and /i (C, E 1 ) = 4, lying in an exact sequence 

— > E — > W (g> Oc(l) — ► Oc(2) — > 0, 

where W £ G(3,fl°(C, O c (l)) has the property that the quadricQ € Sym 2 #°(C, 
induced by S is representable by a tensor in W <g) H°(C, L). This construction is a par- 
ticular procedure of associating vector bundles to non-trivial syzygies, cf. jANj. The 
proof that E is stable is standard and proceeds along the lines of e.g. |GMN| Theorem 
3.2. Next we compute the Clifford invariant: 

7(E) = 3a + ^<ab-2 = Cliff (C), 

since b > 4, so not only Cliff 2 (C) < Cliff (C), but the difference Cliff(C) - Cliff 2 (C) 
becomes arbitrarily positive. 

Proof. By means of Theorem 6.1, there exist a smooth complete intersection surface 
S C P 4 of type (2, 3) such that Pic(S) = Z • H © Z ■ C, where H 2 = 6, H ■ C = d = 6a + b 
and C 2 = 2{g — 1) (Note that such a surface exists when d 2 > 12g, which is satisfied 
when b > 4). The divisor E := C - aH verifies E 2 = 0, E ■ H = b and E ■ C = ab. 
In particular E is effective. The class E is primitive, hence it follows that h°(S, E) = 
h°(C, O c {E)) = 2, where the last equality follows by noting that H 1 (S, O s (E - C)) = 
by Kodaira vanishing. Furthermore, /i 1 (C, Oc{E)) > 3a 2 + 2, that is, Oc{E) contributes 
to Cliff (C) and then we write that 

gon(C) = Cliff (C) + 2 < Cliff (C, O c (E)) + 2 = 06. 

We shall show that Oc{E) computes the Clifford index of C. 

First, we classify the primitive effective divisors F = mH + nC C S having self- 
intersection zero. By solving the equation {mH + nC) 2 = 0, where m,n € Z, we 
find the following primitive solutions: E\ = (3a + b)H — 3C for b ^ 6 (respectively 
£2 = (a + 2)i? — C for 6 = 6), and E% = E = C — aH. A simple computation shows that 
Ei-C > ab for i = 1,2. 

Since Cliff (C) < ab - 2 < [^], the Clifford index of C is computed by a bundle 
defined on S. Following |GL2], there exists an effective divisor D = mH + nC on S, 
satisfying the following numerical conditions: 

(4) h°(S, D) = h°(C, O c (D)) > 2, h°(S, C - D) > 2, D 2 > and D ■ C < g - 1, 
and such that 

f(D) := Cliff (C? c (£>)) + 2 = D - C - D 2 = Cliff (C) + 2. 

Furthermore, can be chosen such that ^{S^D) = 0, cf. E0- T ° bound /(D) and 
show that /(-D) > ab, we distinguish two cases depending on whether D 2 > or 
D 2 = 0. 

By a complete classification of curves with self -intersection zero, we have already 
seen that for any elliptic pencil \D\ satisfying ((4]), one has f(D) > ab = f(E). We are left 
with the case D 2 > and rewrite the inequalities 

(i) (6a + b)m + (2n - l)(3a 2 + 06) < 
(ii) (m + an)(3an + 3m + bn) > 
(in) 6m + (6a + b)n > 2, 
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where (H) comes from the assumption D 2 > and (Hi) from the fact that D ■ H > 2. 
Furthermore, 

(5) f(m, n) := D ■ C - D 2 = -6m 2 + m(d - 2nd) + (n - n 2 )(2g - 2). 

We prove that for any divisor D satisfying (i) -(in), the inequality f(m, n) > ab holds, 
from which we conclude that Cliff (C) = ab — 2. 

Case n < 0. From (Hi) we find that m > 0. Then m < —an or 3m > —(3a + b)n. 
When m < -an, from (Hi) we have that 2 < 6m + dn < —6an + dn = nb < 0, 
which is a contradiction. Suppose (3a + b)n + 3m > 0. For a fixed n the function 
f(m,n) reaches its maximum at mo := d ^~ 2n ^ . So when 3mo + (3a + 6)n < 0, we 
have f(m,n) > f ^ 1 ~ 2n j( g ~ 1 ) ; n ) 7 since by condition (z), m < ( - 1 ~ 2w ] ( - 3 ~ 1 - > . A simple 
computation gives that whenever n < 0, one has the inequality: 

/( u-^i)„) . (2 „ 2 _ 2 „ )(a _4 + fa _ 1) ( 1 _^) 

,fe 2 o — l, o ,9 ,x 3a 2 + a6 
> 4(^-1)— + ^^(l8a 2 +6 2 + 6a6) > > ab. 

Assume now that 3m + (3a + b)n > 0. Since m G (- (i-2n)( g -i) j ^ wg havg 

/(,„.„) > min {/(-(^.^./( t 1 - 2 "to- ') ,„)}. 
A direct computation yields 

/ (_(^±i0=,„) = _„( oi> + |)> ai> + ^> (l6 . 



Case n > 0. If m > we get a contradiction to (i). Suppose m < 0, then we have 
either 3m + (3a + b)n < 0, or else m > —an. The first case contradicts (Hi), so it does not 
appear. Suppose m > —an. Reasoning as before, observe that mo < (1 - 2n)(g — l)/d, 
where mo is the maximum of f(m, n) for a fixed n, and m takes values in the interval 
(—an, ^ 1 ~ 2 "^ g ~ 1 ^ ] • If —an > mo, then f(m, n) > y( ( 1 ~ 2n Kg~ 1 ) ; n )_ Since we are assum- 
ing —an< liz 2 I^£zll / we have that n < ^ + 1. We use this bound to directly show, 
like in the previous case, that /(— —, n) > ab. When — an < mo we have that 

f(m, n) > min{/(-an, n), /( (1 ~ 2 "] (g ~ 1} ,n) }. 
In this case it is enough to note that f(—an,n) = nab > ab. 

Case n = 0. From inequalities (z) and (Hi) with n = 0, we have 1 < m < Note that 
f(m, 0) = —6m 2 + md reaches its maximum at ^. So, since < ^, we conclude that 
f(m, 0) > /(l, 0) = 6a + 6 — 6. Finally, we observe that 6a + b — 6 > ab if and only if 
b < 6. This finishes the proof. □ 
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5. The Fourier-Mukai involution on T\\ 

The aim of this section is to provide a detailed proof of Mercat's conjecture iM%) 
in one non-trivial case, that of genus 11, and discuss the connection to Mukai's work 
[Ml], [M3J. We denote as usual by T g the moduli space parametrizing pairs [S, £], where 
S is a smooth K3 surface and £ G Pic(5) is a primitive nef line bundle with £ 2 = 2g — 2. 
Furthermore, we introduce the parameter space 

V g := { [S, C] : S is a smooth K3 surface, C C S is a smooth curve, [S, O s (C)] eJ 9 } 

and denote by ir : V g — s- T g the projection map [S, C] i— > [S, Os{C)\. If 5 is a K3 surface, 
following (Mil , we set H(S, Z) := H°(S, Z) # 2 (S, Z) i? 4 (S, Z) and 

NS(S) := H°(S, Z) © NS(S) © i? 4 (S, Z). 
We recall the definition of the Mukai pairing on H(S, Z): 

(a , a 2 , 04) • (A), P2, AO := a 2 U /3 2 - a 4 U /3 - ao U /3 4 G H (5, Z) = Z. 
Let now r, s > 1 be relatively prime integers such that g = 1 + rs. For a polarized K3 
surface [S, £} G T g one defines the Fourier-Mukai dual S := Ms(r, £, s), where 

M s {r,£,s) = {E : E is an £- stable sheaf on S, rk(E) = r, a(E) =£, X (S,E) =r + s}. 
Setting v := (r, s) G -^(S, Z), there is a Hodge isometry, see [Ml] Theorem 1.4: 

V> : H 2 (M s {r,£,s),Z) A ^/Zu. 

We observe that £ := V' _1 ((0,^, 2s)) is a nef primitive vector with (£) 2 = 2g — 2, and in 
this way the pair (S, £) becomes a polarized K3 surface of genus g. The Fourier-Mukai 
involution is the morphism FM : — )■ T g defined by FM ([S, £]) := [S,£]. 

We turn to the case g = 11, when we set r = 2 and s = 5. For a general curve 
[C] G At ii, the Lagrangian Brill-Noether locus 

SU C {2, K c , 7) := {E G W c (2 5 20) : det(E) = K c , h°(C, E) = 7} 

is a smooth K3 surface. The main result of [M3J can be summarized as saying a 
general [C] G Atn lies on a unique K 3 surface which moreover can be realized as 

SUc(2, Kc, 7). Furthermore, there is a birational isomorphism 

011 : Atn — > V n , 0u([C]) := [SUc(2^Kc,7),C] 

and we set qu := ir o </> n : Atn — » On the moduli space Atn there exist two 

distinct irreducible Brill-Noether divisors 

Atn, 6 := {[C] G Atn : W£(C) + 0} and At? 1)9 := {[C] G Atn : Wl{C) + 0}. 

Via the residuation morphism Wg(C) iTc © L v G Wf 4 (C), the Hurwitz divisor 

is the pull-back of a Noether-Lefschetz divisor on T\\, that is, At ^ 6 = g*x (-Dg) where 

D\ := G Jii : 3# G Pic(S), H 2 = 8, H ■ £ = 14}. 

Similarly, via the residuation map W|(C) 9 L i-» l<fc ® £ v G Wf^C), one has the 
equality of divisors At 2 1 9 = ^(.Dg), where 

D| : = {[S,£] G Jii : 3# G Pic(S), H 2 = A, H ■ £ = 11}. 
Next we establish Mercat's conjecture for general curves of genus 11. 
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Theorem 5.1. The equality Cliff2(C) = Cliff (C) holds for a general curve [C] G M\\. 

Proof. We fix a curve [C] G M\\ such that (i) W](C) is a smooth curve, (n) W 9 2 (C) = 
(in particular, any Petri general curve will satisfy these conditions) and (in) the rank 2 
Brill-Noether locus SUc{2, Kc, 7) is a smooth K3 surface of Picard number 1. As dis- 
cussed in both [LMNJ Proposition 4.5 and |FO| Question 3.5, in order to verify (M2), 
it suffices to show that C possesses no bundles E G £/c(2, 13) with h°(C, E) = 4. Sup- 
pose E is such a vector bundle. Then L := det(-E) G Wf 3 (C) is a linear series such that 
the multiplication map V2(L) : Sym 2 H°(C, L) — > H°(C, L® 2 ) is not injective. For each 
extension class 

eeP t :=P(Coker^ 2 (L)) v cP( J ff°(C,L 552 )) v = PExt 1 (L,K c ®L v ), 
one obtains a rank 2 vector bundle F on C sitting in an exact sequence 

(6) — > Kc <S> L y — > F — > L — > 0, 

such that h°(C, F) = h°(C, L) + h°(C, K c <8> L v ) = 7. We claim that any non-split vector 
bundle F with h°(C,F) = 7 and which sits in an exact sequence (©, is semistable. 
Indeed, let us assume by contradiction that M c F is a destabilizing line subbundle 
with deg(M) > 11. Since deg(M) > deg^c* <8> L y ), the composite morphism M — > L 
is non-zero, hence we can write that M = L(—D), where D is an effective divisor of 
degree 1 or 2. Because W$(C) = 0, one finds that h°(C, K c ®L V (D)) = 2 and L must 
be very ample, that is, h°(C, L(-D)) = h°(C, L) - deg(L>). We obtain that 

h Q {L) + h G {Kc®L y ) = h°(F) < h (M) + h (K c ®M v ) = h G {L)-de ?l {D) + h {Kc®L y ), 

a contradiction. Thus one obtains an induced morphism u : Fl — > SUc{2, Kc, 7). Since 
SUc{2, Kc, 7) is a K3 surface, this also implies that Coker vi{V) is 2-dimensional, hence 
Pl = P 1 . 

We claim that u is an embedding. Setting A := Kc <8> L y G Wj(C), we write the 
exact sequence -> ff°(C, O c ) -> fl°(C, F V ®L)^ H°(C, K c ® A 55 ^ 2 )), and note that 
the last vector space is the kernel of the Petri map #°(C, A) H°(C, L) ->• H°(C, i^c), 
which is injective, hence /i°(C, F v <8> L) = 1. This implies that it is an embedding. But 
this contradicts the fact that Pic SUc(2, Kc, 7) = Z, in particular SUc{2, Kc, 7) contains 
no (— 2)-curves. We conclude that 1^ (L) is injective for every L G Wf%{C). □ 

This proof also shows that the failure locus of statement (M2) on Mn is equal to 
the Koszul divisor 

©03ii,i3 : = {[C] e M u : 3L G ^ 4 3 (C) such that ^i,i(C,L) ^ 0}. 

Suppose now that [C] G &X)if lls is a general point corresponding to an embedding 

L l 

C ^ P such that C lies on a (2, 3) complete intersection K3 surface S C P . Then 

S = SUc&Kc, 7) and p(S) = 2 and furthermore Pic (5) = Z ■ C ® Z ■ H, where 
H 2 = 6, C ■ H = 13 and C 2 = 20. In particular we note that 5 contains no (— 2)-curves, 
hence S and S are not isomorphic. 

Let us define the Noether-Lefschetz divisor 

Df 3 := {[S,£\ G F u : 3H G Pic(S), H 2 = 6,H-£ = 13}, 

therefore ©tjaf 1>13 = (ZiiPis)- 
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Proposition 5.2. The action of the Fourier-Mukai involution FM : T\\ — > T\\ on the three 
distinguished Noether-Lefschetz divisors is described as follows: 

(i) FM{D\) = D\. 

(ii) FM(Dg) = {[S,£] G F n : 3R G Pic(5) such that R 2 = -2, R ■ £ = 1}. 
(Hi) FM(Df 3 ) = {[S, £} G Jii : 3R G Pic(5) such that R 2 = -2, R ■ £ = 3}. 

Proof. For [S, £} G F u , we set v := (2, £, 5) G (£, Z) and £ := (0, £, 10) G H(fl^Z) for the 
class giving the genus 11 polarization. We describe the lattice ip(NS(S)) C NS(S). 

In the case of a general point of D\ with lattice NS(S) = Z • £ © Z • H, by direct 
calculation we find that ip(NS(S)) is generated by the vectors ^ and (2, £ + H, 12). Fur- 
thermore, (2, £ + JT, 12) 2 = 8 and (2, + £, 12) • I = 14, that is, Pic(5) ^ Pte(S), hence 
Dg is a fixed divisor for the automorphism FM. 

A similar reasoning for a general point of the divisor D 2 shows that the Neron- 
Severi groups ip(NS(S)) is generated by £ and (-1, H-£, -2), where (-1, H-l, -2) 2 = 
—2 and (—1, H — £, —2) • £ = 1. In other words, the class (— 1, H — £, —2) corresponds to 

a line in the embedding S <-\ P 11 . Finally, for a general point of Df 3 corresponding to 
a lattice Z • £ © Z • H, the Picard lattice of the Fourier-Mukai partner is spanned by the 
vectors £ and (-l,H-£,-l), where {-l,H-£,-l) 2 = -2 and (-1, H-l, -1)4 = 3. □ 

Remark 5.3. The fact that the divisor D\ is fixed by the automorphism FM is already 
observed and proved with geometric methods in [M3| Theorem 3. 

Remark 5.4. It is instructive to point out the difference between a general element of 
Df 3 and its Fourier-Mukai partner. As a polarized A'3 surface, SUc{2, Kc, 7) is char- 
acterized by the existence of a degree 3 rational curve u(Pl) C SUc{2, Kc,7). On 

the other hand, the complete intersection surface S C P 4 containing C =-! P 4 , where 
L G W^C), carries no smooth rational curves. It contains however elliptic curves in 
the linear system \Os(C — H)\. Thus the involution FM assigns to a K3 surface with a 

degree 7 elliptic pencil, a K3 surface containing a (— 2)-curve. Since S = SUc{2, Kc, 7), 
it also follows that the complete intersection S is a smooth K3 surface, which a priori is 
not at all obvious. 
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